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PIXEL RESAMPLING SYSTEM AND METHOD 



TECHNICAL FIELD 

The present invention is related generally to the field of computer 
graphics, and more particularly, a system and method for resampling graphics data of a 
5 source image to produce a destination image. 

BACKGROUND OF THE INVENTION 

As display devices of various sizes and increased resolution have been 
developed and the demand for them have increased, the ability for a graphics processing 
system to resize and resample source images and create destination images to take 

10 advantage of the various sized and higher resolution displays is a desirable operation. 
In an electronic display system, color at each pixel is represented by a set of color 
components, and each color component is represented by a sample value. Color 
components such as red, green, blue (RGB) or other representations such as YCbQ are 
well known in the art Whichever representation is chosen, each color component can 

15 be interpreted as a two dimensional array of samples, so three such arrays can represent 
images on display systems. Conceptually, resampling can be viewed as a spatial 
process, working on discrete input samples, represented by each color component in the 
source image arranged in a two-dimensional bitmap. The output samples of the 
destination image are spatially located at fractional sample positions within the input 

20 sample grid. Various interpolation and modeling methods are used to construct 
transition models between samples of the source image from which additional graphics 
data is produced during the resampling operation. 

The additional graphics data is then used to produce larger or higher 
resolution destination graphics images. However, the resulting destination image must 

25 retain an acceptable image quality with respect to the source image. That is, the 
destination image should appear to retain at least a similar visual qualities of the source 
image, such as having nearly the same color balance, contrast, and brightness as the 
original source image. Otherwise, rather than accurately reproducing a larger or higher 
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resolution graphics image of the source image, the resampling operation will 
compromise image quality by introducing image distortion. To this end, various 
resampling algorithms have been developed in order to create high quality destination 
graphics images. 

5 With many conventional resampling algorithms, a transition model 

between input samples along each axis is constructed to provide output sample values. 
Generally good results can be obtained with separable processing along each axis for 
graphics images because image feature cross-sections have the same characteristics 
when viewed at any angle within the image plane, only at different effective sample 
10 rates. The transition models between the input samples are constructed such that the 
output samples interpolated from the transition model create a destination image that 
closely resembles the original or source image. The transition models are typically 
continuous so that an output sample can be generated at any position between the input 
samples. 

15 Although an axis separable cubic model between two input samples can 

provide a model with very desirable reconstruction characteristics, generating the 
models are often cumbersome and result in resampling circuits that include large and 
complicated circuitry. For example, a linear filtering system, such as a finite impulse 
response (FIR) filter, may be used to calculate gradients for a cubic model that produces 

20 acceptable resampling results. However, the resulting resampling circuit includes 
multiple stages and taps from which the coefficients of the cubic model are calculated 
and used to produce interpolated output sample values. Where miniaturization and 
simplicity of implementation are desired, including such a resampling circuit in the 
graphics processing system may not be a desirable solution. Moreover, many 

25 resampling algorithms are developed with preserving spectral content of the source 
image in mind, as with the use of linear filters. However, this method may result in 
destination images that appear blurrier than the source image when viewed at the same 
size. As mentioned previously, it is not desirable for a resampling operation to produce 
a destination image having apparent lower quality than the source image. 

30 Therefore, there is a need for an alternate method and system for 

resampling graphics data of a source image. 
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SUMMARY OF THE INVENTION 

The present invention relates to a resampling system and method for 
determining an output sample value for a destination pixel located between first and 
second adjacent source pixels having respective sample values. The resampling system 
5 solves coefficients for a cubic polynomial transition model between the first and second 
adjacent pixels from the sample values of the first and second pixels and 
approximations of the first and second sample gradients at the first and second pixels, 
respectively. The approximations of the first and second sample gradients are based on 
a multiple of first and second sample slopes estimates, such as twice the value of the 
10 sample slope. Along one axis, an output sample can be obtained from 4 samples nearest 
to it, two before, and two after, fp-u f P , f P +h and f p+2 . The gradient cosited with f p is 
initially estimated as f p - (fp-i) and the gradient cosited as f p + f is estimated as (f p + 2 ) - 

(fp+iY 

Additionally, where the first and second slopes have opposite polarities, 
15 the first and second sample gradients may be approximated as being equal to the first 
and second sample slopes, respectively. An additional third slope may also be 
calculated from the sample values of the first and second pixels and compared with the 
first and second slopes for the approximation of the first and second sample gradients. 
The approximation of the first and second sample gradients are then a multiple, such as 
20 two times, of the lesser of the third slope and the respective slope value. Where the first 
and third slopes have opposite polarities, the first sample gradient may be approximated 
as being equal to the first slope, and where the second and third slopes have opposite 
polarities the second sample gradient may be approximated as being equal to the second 
slope. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram of a computer system in which embodiments 
of the present invention are implemented. 

Figure 2 is a block diagram of a graphics processing system in the 

computer system of Figure 1. 
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Figure 3 is a block diagram of a resampling circuit in the graphics 
processing system of Figure 2 according to an embodiment of the present invention. 

Figure 4 is a diagram representing a sample of pixels in the source 

image. 

5 DETAILED DESCRIPTION OF THE INVENTION 

Embodiments of the present invention provide a method and system for 
approximating gradients of sample pixels during a resampling operation performed on a 
source graphics images. Certain details are set forth below to provide a sufficient 
understanding of the invention. However, it will be clear to one skilled in the art that 

10 the invention may be practiced without these particular details. In other instances, well- 
known circuits, control signals, timing protocols, and software operations have not been 
shown in detail in order to avoid unnecessarily obscuring the invention. 

Figure 1 illustrates a computer system 100 in which embodiments of the 
present invention are implemented. The computer system 100 includes a processor 104 

15 coupled to a host memory 108 through a memory/bus interface 1 12. The memory/bus 
interface 112 is coupled to an expansion bus 116, such as an industry standard 
architecture (ISA) bus or a peripheral component interconnect (PCI) bus. The computer 
system 100 also includes one-or more input devices 120, such as a keypad or a mouse, 
coupled to the processor 104 through the expansion bus 116 and the memory/bus 

20 interface 112. Hie input devices 120 allow an operator or an electronic device to input 
data to the computer system 100. One or more output devices 120 are coupled to the 
processor 104 to provide output data generated by the processor 104. The output 
devices 124 are coupled to the processor 104 through the expansion bus 116 and 
memory/bus interface 112. Examples of output devices 124 include printers and a 

25 sound card driving audio speakers. One or more data storage devices 128 are coupled to 
the processor 104 through the memory/bus interface 112 and the expansion bus 116 to 
store data in, or retrieve data from, storage media (not shown). Examples of storage 
devices 128 and storage media include fixed disk drives, floppy disk drives, tape 
cassettes and compact-disc read-only memory drives. 
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The computer system 100 further includes a graphics processing system 
132 coupled to the processor 104 through the expansion bus 116 and memory/bus 
interface 1 12. Optionally, the graphics processing system 132 may be coupled to the 
processor 104 and the host memory 108 through other types of architectures. For 
5 example, the graphics processing system 132 may be coupled through the memory/bus 
interface 112 and a high speed bus 136, such as an accelerated graphics port (AGP), to 
provide the graphics processing system 132 with direct memory access (DMA) to the 
host memory 108. That is, the high speed bus 136 and memory bus interface 1 12 allow 
the graphics processing system 132 to read and write host memory 108 without the 

10 intervention of the processor 104. Thus, data may be transferred to, and from, the host 
memory 108 at transfer rates much greater than over the expansion bus 116. A display 
140 is coupled to the graphics processing system 132 to display graphics images. The 
display 140 may be any type of display, such as a cathode ray tube (CRT), a field 
emission display (FED), a liquid crystal display (LCD), or the like, which are commonly 

15 used for desktop computers, portable computers, and workstation or server applications. 

Figure 2 illustrates circuitry included within the graphics processing 
system 132 for performing various three-dimensional (3D) graphics functions. As 
shown in Figure 2, a bus interface 200 couples the graphics processing system 132 to 
the expansion bus 116. In the case where the graphics processing system 132 is coupled 

20 to the processor 104 and the host memory 108 through the high speed data bus 136 and 
the memory/bus interface 1 12, the bus interface 200 will include a DMA controller (not 
shown) to coordinate transfer of data to and from the host memory 108 and the 
processor 104. A graphics processor 204 is coupled to the bus interface 200 and is 
designed to perform various graphics and video processing functions, such as, but not 

25 limited to, generating vertex data and performing vertex transformations for polygon 
graphics primitives that are used to model 3D objects. The graphics processor 204 is 
coupled to a triangle engine 208 that includes circuitry for performing various graphics 
functions, such as clipping, attribute transformations, rendering of graphics primitives, 
and generating texture coordinates for a texture map. 

30 A pixel engine 212 is coupled to receive the graphics data generated by 

the triangle engine 208. The pixel engine 212 contains circuitry for performing various 



6 



graphics functions, such as, but not limited to, texture application or mapping, bilinear 
filtering, fog, blending, and color space conversion. A memory controller 216 coupled 
to the pixel engine 212 and the graphics processor 204 handles memory requests to and 
from an local memory 220. The local memory 220 stores graphics data, such as source 
5 pixel color values and destination pixel color values. A display controller 224 is 
coupled to the memory controller 216 to receive processed destination color values for 
pixels that are to be rendered. Coupled to the display controller 224 is a resampling 
circuit 228 that facilitates resizing or resampling graphics images. As will be explained 
below, embodiments of the resampling circuit 228 perform approximations that 
10 simplify the calculation of a model between two sample points for use during 
resampling. The output color values from the resampling circuit 228 are subsequently 
provided to a display driver 232 that includes circuitry to provide digital color signals, 
or convert digital color signals to red, green, and blue analog color signals, to drive the 
display 140 (Figure 1). 

15 Although the resampling circuit 228 is illustrated as being a separate 

circuit, it will be appreciated that the resampling circuit 228 may also be included in one 
of the aforementioned circuit blocks of the graphics processing system 132. For 
example, the resampling circuit 228 may be included in the graphics processor 204 or 
the display controller 224. In other embodiments, the resampling circuit 228 may be 

20 included in the display 140 (Figure 1). Therefore, the particular location of the 
resampling circuit 228 is a detail that may be modified without^ deviating from the 
subject matter of the invention, and should not be used in limiting the scope of the 
present invention. 

Illustrated in Figure 3 is representation of four pixel positions p-1, p, 
25 /?+/, and />+2, and the respective sample valuesJ^/,^,^ + /, andf p + 2 of a source image. 
As mentioned previously, a cubic model may be used between the two input samples p 
and p+I to provide a continuous model having desirable reconstruction characteristics 
for graphics images. As is well known, a cubic model can be solved with four 
constraints. Two of these constraints may be provided by the color values j£ andf p+J at 
30 the two input samples p and /?+/. Two additional constraints may be provided by the 
gradients gr p and gr p +, at, or cosited with, the two input samples/? and/>+/ . 
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The resulting cubic model will go through the two input samples p and 
and will also allow for transition shaping between the input samples. A piece-wise 
cubic polynomial model along an axis is defined and will be valid over a fractional 
input sample position Ap from 0 to 1. Consequently, the model is valid from integer 
5 sample position P to P+i : 

f(P + Ap)=±C[P,ilAp)' 

1-0 

To find the gradients cosited with the two input samples, the equation for 
the cubic model is differentiated with respect to Ap, resulting in: 

gr(P + Ap)= X iC[P, iXAp)'" 1 

1=0 

10 Evaluating the two equations at Ap = {0, 1 } and solving for the four coefficients C[P, i] 
at sample position P results in: 

kp = fp+i — fp 
C[P,3] = gr P+l +gr P -2k P 

C[P,2] = k P -C[P,3]-gr r 
15 C[P,l] = gr P 

C[P,0] = /p 

The four coefficients can be reduced because the relative positions of the contributors to 
the cubic model are of interest, rather than the absolute sample index P. The resulting 
coefficients are: 

20 k = f t -f 0 

C 3 =gr t +gr 0 -2k 

Co = fo 

25 for the cubic equation: 

f(Ap)=±C,(Apy 

1=0 
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The resulting cubic equation, along with the gradients gr 0 and gr { and the sample values 
fo and ft for the two input samples p and p+I provides a piece-wise continuous model 
for resampling. 

A differentiating FIR filter is conventionally used to obtain the gradients 
5 gr 0 and grj at the two sample points. Consequently, the conventional system and 
method typically requires complicated circuitry and algorithms to perform the operation. 
In contrast, embodiments of the present invention use a non-linear algorithm that 
produces sharper images (i.e., have less ringing) compared with conventional filters, but 
may have lower image quality for images having spectral content, such as zone-plate 
10 test signals. Nevertheless, the benefits resulting from the simplicity and processing 
speed afforded by the present invention make it a desirable alternative to conventional 
methods. 

Embodiments of the present invention approximate the gradient values 
for the sample points between which the model is calculated from the gradient value of 
15 a line segment intersecting an input samples and its respective neighbor sample. Thus, 
only four samples are used by the resampling circuit 228 (Figure 2) in the 
approximation of the gradients gr 0 and gr h As illustrated in Figure 4: 

slope 0 =f 0 - 

slop^^f r -f x 

20 where slopeo is used to approximate the gradient gr 0 and slope 2 is used to approximate 
gradient gr h Embodiments of the present invention approximate the gradient values gr 0 
and grj cosited with the two input samples f 0 and// as being roughly twice the value of 
slope Q and slope 2j respectively. That is, 

gr 0 =2 *slope 0 ; and 

25 gr^l + slop^. 

Although embodiments of the present invention use an approximated 
gradient value, the approximation produces a close estimate of the steepest slope within 
a transition between two input samples. Also, single sample-period transitions occur in 
video signals (due to noise or low-pass filter leakage), but they should be small enough 

30 that the resulting algorithm edge placement has no significant visible effect. The 
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gradient approximation results in a model having an edge placed nearly in the correct 
position without actually having to calculate the center position of the edge. Moreover, 
the gradient calculations for gr 0 and grj are simple, and consequently, the algorithm is 
very easy to implement. For example, multiplying the slope 0 or slope 2 by a factor of 
5 two may be performed by a bit shift of a binary value representing the slope value. It 
will be appreciated that this operation may be performed in software or through 
hardware implementation, and the particular method of implementation should not be 
interpreted as limiting the scope of the present invention. 

The gradient approximation of embodiments of the present invention can 
10 result in a slight over-emphasis of gradients when the values of slope 0 and slope 2 are 
opposite in polarity. However, this can be easily remedied using the following test (as 
written in C): 

if(((slopeO < 0) ScSc (slope2 > O) ) || 
((slopeO > 0) USc (slope2 < 0))) 

15 { 

cjrO = slopeO ; 
grl = slope2; 

} 

else 

20 { 

grO = 2 * slopeO ; 
grl = 2 * slope2; 

} 

The resulting cubic model is* less relatively accurate at any shallow area near a large 
25 transition, however, such errors at a shallow gradient are generally not noticeable in the 
resampled graphics image. Additionally, although the approximation is very non-linear 
in its spectral behavior at high frequencies, the resulting resampled image nevertheless 

maintains good image quality. 

The previously described gradient approximation produces quality 

30 graphics images, but some small overshoot problems may appear at sharp transitions 
which can be visible at sharp boundaries between graphics data representing different 
types of graphics images, such as text and video. An alternative embodiment of the 
present invention improves upon the behavior of the previously described embodiments 
by making use of an additional central slope / =// -f 0 . We compare slope / with slope 0 

35 to find the smaller of the two slopes and double the resulting value to approximate the 
gradient gr 0 at sample fa Similarly, this process may be performed independendy using 
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slope i and slope 2 to determine the gradient value gr/ for sample//. Where slope 0 and 
slopei are of opposite sign, such as due to a narrow feature or peak, or from ringing in 
the source material near transitions, the gradient atf/ is made equal to slopes that is, the 
slppe furthest from the model interval from/0 to//. As a result, narrow features are 

5 slightly emphasized. 

The gradient approximation method according to the alternative 

embodiment may be described as follows, as written in C code: 

/* obtain grO using slopeO and slopel */ 
10 if((slopeO > 0) && (slopel > 0)) 

{ 

if(slope0 < slopel) 

grO = slopeO * 2; /* *2 is trivial hardware 

shift */ 
15 else 

grO = slopel * 2; 

else if ((slopeO < 0) && (slopel < 0)) 

20 ^ if (slopeO < slopel) 

grO = slopel * 2; 
else 

grO = slopeO * 2; 

} 

25 else 

grO = slopeO; 

/* obtain grl using slopel and slope2 */ 
if ((slopel > 0) &Sc (slope2 > 0) ) 
30 { 

if (slopel < slope2) 

grl = slopel * 2; 
else 

grl «= slope2 * 2; 

35 } 

else if ((slopel < 0) (slope2 < 0)) 

^ if (slopel < slope2) 
grl = slope2 * 2; 

40 else 

grl = slopel * 2; 

} 

else 

grl = slope2; 

45 The resulting approximated gradient values produce resampled images having good 
image quality. An additional benefit from including the calculation of and comparison 
with slope j is that the slopes of the gradients gr 0 and grj are kept as shallow as possible 
near transitions, which causes the transition itself to be steeper. Additionally, slopei is 
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preserved and can be used to calculate the gradient values for the next sample points fj 
and/2 as we transition to the next piece-wise continuous model. 

The description of the resampling circuit 228 as provided herein is 
sufficient for one of ordinary skill in the art to practice the invention. The resampling 
5 circuit 228 includes conventional logic that is well understood and may be implemented 
without undue experimentation. Consequently, detailed description of the circuitry of 
the resampling circuit 228 has been omitted for the sake of brevity. 

As mentioned previously, the transition model between input samples 
can be constructed along each axis to provide output samples for a resampled graphics 

10 image. Thus, although not specifically discussed herein, it will be appreciated that 
embodiments of the present invention perform the gradient approximation along each 
axis of a source image when performing the resampling operation. Additionally, it will 
be appreciated that the color values of the sample pixels consist of several color 
components. For example, the color values of the source and destination pixels may be 

15 the combination of red, green, and blue color components. Consequently, the invention 
may be practiced for multi-component color values although it has not been described in 
detail because multi-component color values and image processing of the same is well 
understood by one of ordinary skill in the art. 

m 

From the foregoing it will be appreciated that, although specific 
20 embodiments of the invention have been described herein for purposes of illustration, 
various modifications may be made without deviating from the spirit and scope of the 
invention. Accordingly, the invention is not limited except as by the appended claims. 



